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1.  Introduction 

The  natural  solution  to  many  problems  in  probability  theory  and  mathemati¬ 
cal  statistics  is  provided  by  an  examination  of  certain  limit  distributions.  As  is 
the  case  in  the  classical  problem  of  the  summation  of  a  large  number  of  random 
variables  which  are  in  some  sense  of  equal  weight,  the  study  of  the  exact  distri¬ 
bution  functions  of  the  sums  not  only  leads,  as  a  rule,  to  intractable  formulas 
but  in  many  important  cases  is  impossible,  since  the  exact  distributions  of  the 
separate  summands  are  often  unknown.  On  the  other  hand,  limit  distributions 
are  almost  independent  of  the  idiosyncrasies  of  the  distributions  of  the  summands 
and  have  a  quite  manageable  form.  The  same  phenomenon  can  be  observed  in 
mathematical  statistics  in  the  study  of  statistical  criteria  for  a  large  number  of 
observations.  As  a  rule,  the  exact  criteria  are  complicated  but  their  limiting  form 
is  simple  and  convenient  for  application.  An  excellent  example  of  this  situation 
is  the  treatment  of  statistical  mechanics  by  A.  I.  Khinchin,  in  which  limit  theo¬ 
rems  play  an  outstanding  role.  Examples  of  this  kind  are  literally  innumerable. 

However,  as  was  pointed  out  a  long  time  ago  by  P.  L.  Chebyshev  [1],  in  order 
to  be  able  to  apply  limit  theorems  in  practice,  it  is  necessary  to  have  an  estimate 
of  the  error  involved.  Obviously,  if  the  remainder  terms  decrease  slowly,  then  the 
limiting  distributions  must  be  used  with  corrections.  Currently  the  most  power¬ 
ful  and  general  method  for  finding  corrections  of  this  nature  is  the  method  of 
asymptotic  expansions.  These  expansions  were  first  examined,  without  an  exact 
foundation,  by  Chebyshev  [2]  for  the  case  of  the  classical  limit  theorem.  Later, 
expansions  of  Chebyshev’s  type  were  studied  by  H.  Bruns  [3],  C.  Charlier  [4], 
and  F.  Y.  Edgeworth  [5].  However,  the  fullest  results  in  this  direction  were  ob¬ 
tained  much  later  by  H.  Cram4r  [6]  and  by  C.  G.  Esseen  [7].  We  shall  not  con¬ 
cern  ourselves  here  with  the  numerous  further  improvements  in  precision,  since 
that  is  not  the  basic  object  of  this  paper.  Nor  shall  we  dwell  on  tiie  series  of  inter¬ 
esting  investigations  of  recent  years,  which  studied  asjunptotic  distributions  for 
the  sums  of  random  variables  and  vectors  forming  a  simple  Markov  chain.  To  a 
considerable  extent,  these  works  repeated  methods  which  had  been  worked  out 
for  the  sums  of  independent  random  variables  and  essentially  consisted  of  the 
use  of  the  properties  of  the  Fourier  transforms  of  functions  of  bounded  variation. 

The  asymptotic  analysis  of  the  distributions  of  functionals  of  sums  of  random 
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variables  began  quite  recently.  The  first  result  in  this  direction  seems  to  be  due 
to  N.  V.  Smirnov  [8].  This  result  is  concerned  with  the  speed  of  convergence  of 
the  distribution  of  the  normed  maximal  difference  between  the  true  distribution 
function  and  the  corresponding  empirical  distribution  function,  when  the  number 
of  observations  on  which  the  latter  is  based  is  indefinitely  increased.  Let  F{x)  be 
the  distribution  function  of  an  observable  random  variable  and  assume  that  it  is 
continuous.  Let  n  be  the  number  of  independent  observations  and  let  Fn{x) 
denote  the  corresponding  empirical  distribution  function.  Smirnov  studied  the 
random  variable 

(1)  =  Vw  sup  [/^n(a:)  — 

—  »  <X  <  “ 

and  found  the  following  facts  [8]. 

For  0  <  a;  <  we  have 

(2)  (x)  =  P  {D^  <  x} 

_  /  xVn  y  /n\  (k  —  xVnY(n  —  fc  + 

\  Vn/  t=i+[xV«]\^/ 

Also,  we  have  ^nix)  =  0  for  x  <  0  and  ^n(x)  =  I  ior  x  >  Vn.  Another  result 
of  Smirnov  is  that,  for  all  x  >  0, 

(3)  $+(a:)  =  lim  4>n  (a:)  =  1  — 

n— >00 

and,  for  0  <  X  < 

(4)  +  + 

Later,  another  term  of  the  asymptotic  expansion  was  found  by  N.  1.  Karplev- 
skaia,  a  student  at  the  University  of  Lvov.  Her  unpublished  result  (1949)  is 

(5)  (X)  =  1  -  e- [l  +  ^  +  f  (l  -  f )  +  ]. 

Chan  Li-Tsian  added  still  another  term  [9]  in  this  expansion.  As  a  result,  for 
0  <  X  <  0(n^/®),  we  have 

(6)  ^^(x)  =  1  - 


2x 

2x2/. 

2x2  N 

1  4x  /I 

19x2 

1  2x^\  I  9\" 

3n  V 

9n2/2  (5 

15 

+  -y  j  +  0(n-2) 

A  little  later  than  Smirnov,  and  independently  from  him,  Z.  W.  Birnbaum  and 
F.  H.  Tingey  [10]  also  found  a  result  equivalent  to  (2),  differing  from  it  only  in 
notation. 

Using  the  exact  distribution  of  the  variable 

D„  =  Vn  sup  IFn(x)  —  F(x)| 


(7) 
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and  performing  elegant  calculations,  Chan  Li-Tsian  [11]  succeeded  in  obtaining 
the  expansion 


(8) 


Fnix)  =  P{Dn  <  a:}  =  E  rr^f^Krix)  +  0{n-^-), 

r  =0 


where  the  symbols  Kr  in  formula  (8)  mean 
Koix)  =  E  (-l)^e-2^^-’, 

K,ix)=-f  E 

o  jfc=-oo 

(9)  K,(x)  =  -^  E  (-mh-4(fi  +  3)kV  +  &k‘x‘]e-^'^^, 

lO  *=  _  00 

fi  =  sin^  fi  =  5k^  +  22  —  15  sin^ 


The  use  of  exact  distributions  in  order  to  obtain  asymptotic  expansions  is 
found  in  a  note  by  B.  V.  Gnedenko  [12],  given  to  the  study  of  the  maximal 
deviations,  both  one-sided  and  two-sided,  between  two  empirical  distribution 
functions,  each  based  on  the  same  number  of  independent  observations. 

It  is  obvious  that,  given  the  exact  distribution  corresponding  to  a  fixed  value 
of  the  parameter  n,  it  is  always  possible  to  obtain  an  asymptotic  power-series 
expansion;  success  here  depends  only  on  the  manipulative  skill  of  the  research 
worker.  However,  this  method  of  obtaining  asymptotic  expansions  can  hardly  be 
considered  interesting  mathematically.  In  the  first  place,  each  improvement  in 
precision  of  the  formula  already  obtained  requires  a  repetition  of  the  calculations 
performed  earlier.  In  the  second  place,  the  method  requires  the  knowledge  of  the 
exact  distribution,  and  it  is  this  last  problem  by  itself  that  is  likely  to  present 
considerable  difficulties.  Thus  there  is  an  acute  need  for  a  method  that  would 
permit  us  to  find  asymptotic  expansions  without  first  having  to  determine  the 
exact  distributions  for  all  n. 

In  this  particular  respect  the  works  of  H.  E.  Daniels  [13],  I.  I.  Gikhman  [14], 
[15],  and  V.  S.  Koroluk  [16],  [17],  [18]  are  of  undoubted  interest,  since  not  only 
did  they  solve  separate  particular  problems  but  they  also  laid  the  foundation  of 
a  general  method  for  obtaining  asymptotic  expansions.  Daniels’  article  examined 
the  asymptotic  expansion  of  the  probability  density  function  of  the  arithmetic 
mean  of  identically  distributed  summands.  Gikhman  studied  the  asymptotic 
expansions  of  the  expected  value  of  sufficiently  smooth  functions  of  random 
variables  forming  a  Markov  chain.  These  expansions  were  obtained  as  a  result  of 
an  analysis  of  the  equation  determining  the  required  expectation.  In  particular, 
if  the  independent  identically  distributed  random  variables  ^i,  ^2,  •  •  *  ,  In  have 
moments  of  the  first  three  orders  and  the  function  f{x)  is  uniformly  continuous 
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and  bounded,  together  with  its  derivatives  up  to  the  fifth  order  inclusive,  then 
we  have  the  equation 


(10)  E  {/(^  .t  {,)}  =  /(a.)  +  ^  -  «?)/"(“■) 


+ 


nuL  3!  2!  ^ 


(a2  —  afy 
(2!y 


+  o(n--), 


where  Uk  =  E  . 

Koroluk  studied  the  asymptotic  expansions  for  the  maximal  deviations  in  a 
Bernoulli  scheme  using  a  recurrent  system  of  differential  equations.  A  mistake 
which  slipped  into  papers  [16]  and  [17]  served  to  clarify  the  difficulties  and 
pitfalls  that  threaten  the  research  worker.  It  turned  out  that  in  his  first  works 
Koroluk  did  not  take  into  account  the  effect  of  a  jump  through  the  limit,  with 
the  result  that  in  the  formulas  he  obtained  several  terms  of  the  expansion  were 
omitted.  This  was  pointed  out  by  A.  N.  Kolmogorov.  His  observations  were  used 
by  A.  A.  Borovkov  in  [19]  and  [20]  in  the  study  of  large  deviations  of  the  maxi¬ 
mum  of  sums  of  independent,  identically  distributed,  bounded  lattice-like  sum¬ 
mands. 

We  limit  ourselves  to  these  few  references  to  the  existing  literature,  and  make 
no  claim  to  present  an  exhaustive  study  of  the  history  of  the  question. 


2.  Random  walks  with  assigned  boundaries.  Boundary  layers 

2.1.  A  number  of  fundamental  problems  of  mathematical  statistics  and  prob¬ 
ability  theory  fit  naturally  into  a  scheme  of  random  walk  between  some  bound¬ 
aries.  In  the  case  of  random  walk  over  a  lattice,  difference  equations  are  ob¬ 
tained  with  some  boundary  conditions.  The  well-known  book  by  W.  Feller  ([21], 
chapter  14)  is  an  excellent  introduction  to  this  type  of  problem.  In  particular, 
it  is  known  that  the  distribution  of  the  above  statistics  D„,  introduced  by  Kol¬ 
mogorov,  is  contained  in  this  scheme.  In  addition  to  the  determination  of  exact 
solutions  for  such  problems,  their  asymptotic  analysis  is  of  considerable  interest 
in  the  case  when  we  assume  that  the  variation  of  position  of  the  particle  in  one 
step  of  the  random  walk  will  with  overwhelming  probability  become  infinitely 
small. 

For  the  solution  of  problems  of  this  type  the  following  method  can  be  sug¬ 
gested.  The  desired  distribution  is  regarded  as  the  solution  of  the  equation 

(11)  I\u,  =  0, 

depending  on  the  small  parameter  e,  which  when  e  — ^  0  degenerates  into  the 
differential  equation 

(12)  L(jUo  =  0 

of  elliptic  or  parabolic  type.  In  order  to  find  the  asymptotic  expansion 

00 

We  ~  I] 
k  =  0 


(13) 
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which  is  to  be  interpreted  as  meaning 

(14)  —  Z  =  o(e^), 

fc-O 

methods  can  be  used  which  were  worked  out  since  the  times  of  Henri  Poincare  in 
the  theory  of  differential  equations  with  a  small  parameter.  This  approach  was 
employed  in  the  previously  mentioned  papers  by  Gikhman  and  Koroluk.  How¬ 
ever,  as  we  shall  see  presently,  in  the  study  of  limit  problems  which  arise  from 
problems  of  random  walks  with  absorbing  or  other  types  of  barriers,  the  degen¬ 
eration  of  equation  (11)  leads  to  the  degeneration  of  the  boundary  conditions. 

The  usual  process  for  the  asymptotic  solutions  of  equations  with  a  small 
parameter  consists  of  the  expansion  of  the  original  operator  Pt  into  a  series 

(15)  P f  =  Lq  eLi  -|-  -!-•••. 

Then  a  formal  solution  of  (11)  is  sought  in  the  form  of  the  series 

(16)  Ut  =  t^Uk. 

k=Q 

By  substituting  this  series  into  the  original  equation  and  comparing  terms  with 
the  same  power  of  c,  a  recurrent  system  of  equations  is  obtained  that  determines 
successively  the  terms  of  the  asymptotic  expansion 

PqUq  =  0, 

(17) 

LoUm  ~  Lm~kUk> 

fc  =  0 

Generally,  the  method  just  described  is  ineffective.  The  reason  is  that,  while 
each  successive  step  in  the  recurrence  process  reduces  the  inconsistencies  involved 
in  the  earlier  terms  of  the  expansion,  the  inconsistencies  in  the  fulfillment  of 
boundary  conditions  remain  untouched. 

A  similar  situation  was  noted  by  M.  I.  Vishik  and  L.  A.  Liusternik  in  the 
asymptotic  analysis  of  limit  problems  for  differential  equations  in  which  higher 
order  derivatives  have  “small"  coefficients.  Their  results  are  summarized  in  the 
large  paper  [22].  The  basic  idea  they  used  is  as  follows:  insofar  as  the  terms  of  a 
regular  asymptotic  expansion,  defined  by  means  of  the  system  of  equations  (17), 
bring  inconsistencies  in  the  fulfillment  of  boundary  conditions,  it  is  essential  to 
examine  the  complementary  terms  of  the  asymptotic  expansion,  which  would 
act  only  near  the  boundary  and  would  compensate  for  the  inconsistencies  in  the 
fulfillment  of  boundary  conditions.  Liusternik  and  Vishik  called  these  terms  of 
the  asymptotic  expansion  terms  of  the  boundary  layer  type. 

Recently  the  application  of  this  idea  to  problems  of  probability  theory  has  been 
the  subject  of  studies  of  Koroluk  [23],  [24].  Naturally,  the  difference  operators, 
the  integral  and  the  integro-differential  operators  P*  become  particularly  impor¬ 
tant  in  this  domain.  The  splitting  of  the  original  operator,  which  would  warrant 
the  second  of  the  two  processes  mentioned,  is  more  difficult  here  than  for  differ¬ 
ential  equations  with  small  coefficients  of  higher  derivatives.  The  general  idea 
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just  described  will  be  illustrated  with  the  example  of  a  one-dimensional  random 
walk  on  a  lattice  with  step  e. 

Let  Ui(x)  denote  the  probability  that  the  moving  particle  starting  from  a;  >  0 
will  reach  the  position  y  ^  0  before  visiting  the  region  y  ^  1.  Further,  let 
denote  the  probability  of  transition  from  a:  to  a;  -}-  Zee  in  a  single  step.  For  con¬ 
venience  in  subsequent  calculations,  the  probability  that  the  moving  particle 
will  remain  at  x  will  be  denoted  by  1  po,  with  po  <  0  defined  by  p*  =  0. 
The  required  probability  satisfies  the  equation 

(18)  PtUt{x)  =  PkUt{x  -f  ke)  =  0, 

—  ao 

subject  to  the  boundary  conditions 

(19)  Ut(  —  er)  =  1,  M((l  re)  =  0,  r  ^  0. 

We  shall  assume  that  the  distribution  p*  has  -1-  3  finite  moments,  for  which 
we  introduce  the  notation 

(20)  ea.  =  E  kpk,  =  I E  Tr*  =  ^  E  k^k, 

for  3  ^  r  ^  W  -f-  3.  We  shall  assume  further  that  the  distribution  p*  is  AT  -f  3 
times  differentiable  with  respect  to  e,  which  yields  the  expansion 

JV+2 

(21)  Pk  =  PkO  +  E  C’-pfcr  +  e^+®p/,e. 

r  =  l 

The  above  assumptions  lead  to  the  expansions 

N+2 

(22)  a,  =  ao  +  E  t'’"*  +  c^'''W+2.e, 

8  —  1 

N-\-2 

(23)  =  ^0  +  E  m 

8=1 

Ar-f2 

(24)  7r,  =  TrO  +  E  t’Trs  +  N +S.e- 

8  =  1 

It  is  known  (see  [25],  chapter  3)  that,  when  e  ^  0,  the  probability  Ut{x)  tends 
to  that  solution  ito(x)  of  the  second  order  differential  equation 

which  satisfies  the  boundary  conditions 

(26)  Wo(0)  =  1,  Mo(l)  =  0. 

In  this  way,  when  €  — »  0,  the  difference  equation  (18)  degenerates  into  the 
differential  equation  (25)  and,  as  can  be  seen  easily  by  comparing  (19)  and  (26), 
the  boundary  conditions  are  lost. 

In  accordance  with  the  above  general  idea  of  the  asymptotic  method,  the 
asymptotic  series  for  the  required  probability  Ut{x)  will  contain  regular  asym- 
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totic  terms  (bounded  and  having  bounded  derivatives  of  all  orders)  and  asymp¬ 
totic  terms  of  the  boundary  layer  type,  which  decrease  to  zero  at  infinity  (see 
[22]).  Thus  we  shall  seek  an  asymptotic  expansion  of  the  form 

(27)  u,(x)  =  Z  t'Urix)  +  t  ‘  [  V,-  (2)  +  F.+  (^^)]  +  Z.(x), 

where  Ur(x)  are  the  regular  terms  of  the  expansion,  where  Vr  and  are  the 
boundary  layers  at  the  points  x  =  0  and  x  —  1,  respectively,  and  Zt  is  the 
remainder  term. 

In  order  to  determine  the  regular  terms  of  the  expansion,  Taylor’s  formula 
and  the  expansions  (22)  to  (24)  are  used  to  construct  a  recurrent  system  of 
differential  equations.  As  a  result,  as  indicated  in  (15),  the  operator  P*  on  the 
class  of  infinitely  differentiable  functions  is  split  into  components  of  the  type 


(28) 


r  ^  j-  fit 

T  ^  A.  »  A.  ^ 


dx^+- 


l  ^  r  ^  N. 


Thus,  for  the  determination  of  the  regular  terms  of  the  asymptotic  expansion, 
we  obtain  a  system  of  differential  equations  of  the  type  (17),  with  the  operator 
Lr  defined  by  (28).  The  boundary  conditions  for  the  regular  term  Ur  will  be 
chosen  so  as  to  compensate  for  the  inconsistencies  of  the  boundary  layers  Fr~_  i 
and  Fr'ti  at  the  boundary  points  a:  =  0  and  x  =  \.  Indeed  we  write 

(29)  w.(0)  =  -Fr-i(O),  M.(l)  =  -F+:(0). 

The  equations  for  the  boundary  layers  are  determined  by  a  different  process. 
After  substituting  (27)  in  (18)  and  carrying  out  the  process  for  determining  the 
regular  terms  of  the  expansion,  we  arrive  at  equation 

(30)  ^  [f.-  (;  +  *:)  +  vf  (5^  +  *•)]  +  z,(x  +  *))|  =  0, 

Using  the  asymptotic  expansion  for  p*  we  obtain  from  it  equations  determining 
Fr  and  Fr"^  by  equating  to  zero  the  coefficients  of  the  different  powers  of  e, 
separately  for  Fr  and  Fr'^.  In  the  result  Fr  is  determined  as  the  solution  of 
equations 


(31)  Po[Fo-(p)]  =  L  Vi^Voiy  +  A;)  =  0 

—  X 

and 

(32)  Po[Fr(?/)]  =  -  L  t  VklVr_,{y  +  -t  Pi\yr-im 

1  =  1  k—  —  oa  J  =  1 

on  the  semiaxis  y  ^0  that  tends  to  zero  at  +=o,  and  takes  given  values  for 
y  <  0.  The  meaning  of  the  operators  Pt  is  clear  from  equations  (31)  and  (32). 

In  exactly  the  same  way  Fr"*"  is  determined  as  the  solution  of  equations 
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(33)  Po[FJ-(y)]=  £  +  =  0 

and 

(34)  Po[F/(2/)]  =  -i:  t  P^V^-iiy k)  =  -t  Pi[VrU{y)] 

z  =  i 

on  the  semiaxis  y  ^  0  that  takes  given  values  when  y  >  0  and  tends  to  zero 
when  y  —<x> . 

We  determine  the  boundary  conditions  for  the  boundary  layers  Vr  in  such  a 
way  that,  in  the  fulfillment  of  conditions  (19)  when  y  <  0  by  the  function 

(35)  Wn(x)  =  XI  i^ui(x)  -f-  ^  e^+'i;r 

i=o  1=0  \e/ 

the  inconsistency  should  be  of  the  order  0(e’“''^).  With  this  object  in  mind,  the 
regular  terms  of  the  expansion  are  first  extended  in  a  continuous  differentiable 
way  beyond  the  limits  of  the  interval  (0,  1).  Let  us  consider  for  ^  <  0  the  differ¬ 
ence 


(36) 

wjfitt)  —  1  =  uo(et)  —  1  +  52  e'[wj(cO  ~  yz-i(o)]  +  52  e^+‘[yr(0  —  t^r(o)]. 

1=1  1=0 


By  applying  Taylor’s  formula  to  the  regular  terms  and  equating  the  coeffi¬ 
cients  of  equal  powers  of  c,  we  obtain 


(37) 


Vr-{t)  =  7r(0)  - 


,=1  s!  dx^ 


The  values  of  the  boundary  layers  V^{t)  when  t  >  1  are  determined  in  an 
analogous  way, 


(38) 


F+(0  =  F+(l)  - 


'■+1  p  a»u.+i-,(i) 
,=i  s!  dx* 


By  direct  verification  we  can  now  ascertain  that  the  algorithm  we  have 
constructed  leads,  for  the  remainder  term,  to  equation 

(39)  P.{Z,{x)]  =  t^'^^gix), 

where  g{x)  is  a  function  bounded  in  (0,  1)  and  the  boundary  conditions  for 
Zt{x)  are  of  the  order  0(e^+^).  From  this  we  conclude  that 

(40)  Z,{x)  =  O(e^'+0. 

The  boundary  layers  of  equations  (31)  to  (35)  can  be  found  using  the  factor¬ 
ization  method  developed  by  M.  G.  Krein  [26]  for  integral  equations  on  the 
half  line.  We  assume 

4’o(X)  =  E 


9(X) 


4>o(X) 

X  -  2  +  X2 


E  9fcX^ 


(41) 

For  the  function 

(42) 


IXl  -  1. 
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factorization  is  possible  on  the  circle  [X|  =  1.  In  other  words,  there  exists  the 
representation 

(43)  g(X)  =  g+(X)g_(X), 

in  which  the  functions  g+(X)  and  q-{\)  are  analytic  and  nonzero  inside  and 
outside  the  unit  circle,  respectively.  Thus 

(44)  q+{\)  =  E  ?fc+X*=,  g_(X)  =  E  (,rX-^ 

*=0  A=0 

The  representation  (43)  enables  us  to  transform  the  equations  for  Fr  (0 
(t)  into  the  form 

(45)  E  qt  Vo  {t  -  k)  =  0,  E  Qk  Fo+  {t  k)  =  0. 

k=0  k=0 

The  boundary  layers  Vr  (0  are  determined  in  the  form  of  a  sum 

(46)  Fr(0  =  Fro(0  +  £  kwr{t  +  k), 

k=0 

where  wr  (t)  is  the  solution  of  the  nonhomogeneous  equation 

(47)  E  q,Wr-{t  +  fc)  =  -  E  Pl[Vr--iit)] 

k=  —  00  J  =  1 

on  the  semiaxis  t  ^  0  that  is  equal  to  zero  when  t  <  0,  and  Fk)(0  is  the  solution 
of  equation  (44)  that,  when  t  <  0,  takes  the  values 

(48)  V;o(t)  =  Vr-{t)  -  t  (k-  t)Wr-{t). 

A=0 

The  functions  Vi^  (t)  are  determined  in  a  similar  way. 

We  omit  here  the  details  of  the  proof  of  the  proposed  method,  since  this 
requires  deep  involvement  in  analytical  detail. 

2.3.  To  illustrate  the  application  of  the  proposed  algorithm  let  us  examine 
the  case  when  the  initial  distribution  of  the  size  of  the  jumps  does  not  depend  on 
€,  and  the  mathematical  expectation  of  the  size  of  the  jump  is  equal  to  zero.  In 
this  case,  as  can  be  calculated  easily,  the  regular  terms  of  the  asymptotic  expan¬ 
sion  have  the  form 

(49)  Uo(x)  —  I  —  X,  Ur{x)  =  ttr  +  brX,  r  =  1,  2,  •  •  •  . 

In  accordance  with  (29) , 

(50)  ar  =  —  Fr-l(O),  ttr  +  br  =  -Fr'ti(O). 

As  indicated  above,  the  boundary  values  for  the  boundary  layers  are  determined 
by  the  equations 

(51)  Vr-(t)  =  Fr(0)  -  brt,  F+(0  =  F+(0)  -  brt. 

Equations  (45)  give 

(52) 


Fr(0)  =  brq-, 


F+(0)  = 
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where 

(53) 


U- 


q-(l) 


Simple  calculations  lead  to  the  following  regular  part  of  the  asymptotic 
expansion 


(54) 


u,(x)  =  1  + 


_ 

1  -  c(gr_  -  q^) 


_ X _ 

1  -  e(g_  -  q+) 


This  function  gives  the  solution  of  the  asymptotic  problem  considered,  with 
accuracy  up  to  any  power  of  e,  valid  within  the  interval  (0,  1).  Outside  of  fixed 
neighborhoods  of  the  points  a:  =  0  and  a:  =  1 ,  the  boundary  layers  tend  to  zero 
faster  than  any  power  of  e  and,  therefore,  do  not  influence  the  asymptotic 
expansion.  It  is  interesting,  that  in  the  present  case  it  is  possible  to  avoid  the 
necessity  of  determining  the  boundary  layers. 

It  is  known  the  determination  of  the  distributions  of  the  statistics  IX  and  Dt , 
referred  to  at  the  beginning  of  this  paper,  can  be  reduced  to  the  solution  of 
certain  difference  equations  (see,  for  example,  [24]  and  [27]).  The  algorithm 
just  described  was  used  in  [24]  to  obtain  the  asymptotic  expansions  of  the 
distributions  of  these  statistics.  Naturally,  the  result  obtained  coincides  with 
that  of  Chan  Li-Tsian  [11]  which  we  indicated  in  the  introduction.  We  cannot 
dwell  here  on  a  detailed  examination  of  the  series  of  interesting  special  problems 
in  probability  theory  to  which  the  algorithm  we  have  constructed  is  applicable. 
We  intend  to  do  this  in  other  publications. 


3.  Rate  of  convergence 

3.1.  The  following  method  may  be  used  to  estimate  the  rate  of  convergence 
of  the  distribution  functions  F„{x)  to  a  limiting  distribution  function  F{x)  or  to 
obtain  the  asymptotic  expansions  of  Fn{x).  A  random  variable  is  constructed, 
possessing  the  distribution  Fn{x)  and  depending  upon  n  in  the  simplest  possible 
manner.  Let  us  assume  that  we  have  succeeded  in  representing  in  the  form 

(55)  ^  OC,Vn 

where,  as  n  oo ,  the  coefficient  a,.  0  and  the  random  variables  77„  tend  in 

probability  to  a  random  variable  tj.  If  Erjn  ^  C  then,  for  every  function  g, 
bounded  and  having  two  bounded  derivatives, 

(56)  Eg(^n)  =  j  g{x)dFn{x)  -  Egij^)  +  a„AV'(^)r7  +  o(q!„). 

In  this  manner,  if  the  joint  distribution  of  ^  and  -q  is  known,  it  is  possible  to 
obtain  an  asymptotic  representation  of  the  expected  value  of  any  sufficiently 
smooth  function. 

In  some  cases  the  representation  (55)  makes  it  possible  to  estimate  the  speed 
of  convergence  of  Fn{x)  to  F{x).  For  this  purpose  use  can  be  made  of  the  fact 
that  for  any  /i  >  0  we  have  the  inequalities 
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(57)  P{^<x-h}  -  P{M  ^h}  <  P{^„  <  x} 

<  P{^  <  X  +  /i}  +  P{\anri„\  ^  h}. 

This  implies  that 

(58)  |Pfe<x}  -P{|<x}| 

g  P{^  <  X  +  A}  -  p{^<x-h}  +  2P{|a„7,„|  ^  h}. 

If  at  the  point  x  the  function  F{x)  satisfies  a  Lipschitz  condition  with  constant 
K  and  E<l){r}n)  ^  C,  then 

(59)  |F,(x)  -  f(.)l  S  2Kh  + 

The  following  lemma  may  be  helpful  in  many  cases  in  the  study  of  convergence 
of  sums  of  independent  random  variables  to  a  Brownian  process.  Here  stands 
for  a  functional  on  the  increasing  sums  and  one  tries  to  obtain  the  representa¬ 
tion  (59). 

Lemma.  Let  $(x)  be  a  distribution  function  such  that 

(60)  f  x^(x)  =  0, 

and  let  w{t)  be  a  Brownian  process.  Then  there  exists  a  random  variable  r  such  that 
w{t)  has  the  distribution  function  ^(x),  the  event  (t  >  s}  is  independent  of  w(t)  — 

w{s)  when  t  >  s,  and  w(t)  —  w{s)  does  not  vanish  when  s  <  r.  If  j  xH^{x)  <  « , 
then 

(61)  Et  =  j  xH^{x). 

f  x^”d$(x)  <  00,  then  P{t"}  <  oo.  Finally,  if  there  exists  a  constant  C  >  0 

such  that  ^(C)  —  ^{  —  C)  =  1,  then  |tt;(s)l  ^  C  when  s  <  t. 

Proof.  It  is  sufficient  to  give  the  argument  only  for  the  case  when  the 
distribution  ^>(x)  is  discrete.  First  let  ^>(x)  have  only  the  two  points  of  growth, 
—Xi  and  X2  with  jumps  pi  and  p2.  By  assumption  Xipi  -f  X2P2  =  0.  We  shall 
denote  by  t  the  moment  at  which  the  process  w{t),  starting  at  the  point  0  first 
reaches  the  boundary  of  the  interval  (xi,  X2).  Then  w{t)  takes  the  values  Xi  and 
X2.  Since  Ew{t)  =  0,  the  probabilities  pi  and  p2,  with  which  w{t)  takes  the 
corresponding  values  Xi  and  X2,  satisfy  the  equations  pi  +  P2  =  1  and  xipi  -b 
X2P2  =  6.  This  yields  pi  =  pi  and  p2  =  P2. 

The  fact  that  the  event  {r  >  s}  is  independent  of  w{t)  —  w{s)  follows  from 
the  fact  that  the  event  {t  >  5}  is  completely  determined  by  the  behavior  of  wit) 
for  <  ^  s.  It  is  easy  to  show  that 


(62) 


Pi  == 


X2 

- ; 

X2  —  Xi 


and,  consequently,  that 


p2  =  - 


Xi 


X2  —  Xi 


(63) 


Et  —  —  X1X2  =  Xipi  -b  a^p2. 
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Now  let  4>(a:)  denote  an  arbitrary  discrete  distribution  with  j  xd^  =  0.  This 
distribution  4>(a:)  can  be  represented  as  a  mixture  of  discrete  distributions  ^k(x), 
each  possessing  only  two  points  of  growth,  and  x^\  for  which  j  xd^k  =  0.  In 
other  words,  we  can  write 

(64)  4>(a:)  =  f)  XkM^), 

*=1 

where  X  =  1  ^'-^6  ^  0  for  all  k.  In  this  case  we  construct  the  random 

variable  t  by  the  following  method.  First,  among  the  positive  integers  we  choose 
at  random  one,  the  probability  of  choosing  k  being  \k-  If  the  integer  selected  is  m, 
we  choose  r  to  be  equal  to  the  value  of  t  at  which  w{t)  would  first  reach  the 
boundary  of  the  interval  x^^'*).  We  omit  the  proof  that  in  this  case  also  the 
random  variable  t  satisfies  all  the  conclusions  of  the  lemma.  In  the  general 
case,  the  proof  of  the  lemma  is  achieved  by  approximating  $(x)  by  a  discrete 
distribution  function. 

In  order  to  illustrate  the  applications  of  the  lemma,  we  shall  consider  a  se¬ 
quence  of  independent  random  variables  •  •  •  ,  and  a  sequence  of  corre¬ 
sponding  distribution  functions  4*i(a:),  ^2(x),  •  •  •  ,  We  shall  assume  that  for 

each  j  =  1,2,  •  •  •  ,n  the  expectation  E^j  =  0.  As  before,  let  w(t)  stand  for  the 
Brownian  motion  process.  Now,  we  use  the  lemma  and  denote  by  n  the  random 
variable  satisfying  its  conditions  and  such  that  w{ti)  has  the  distribution  function 
4*1(0:). 

For  each  s  >  0  the  process  w{s  ti)  —  w{ti)  also  will  be  a  Brownian  process 
and  moreover  will  be  independent  of  w{ti).  Let  t2  be  a  random  variable  satis¬ 
fying  the  requirements  of  the  lemma  for  the  process  w(s  n)  —  w{ti)  and 
having  the  distribution  function  4*2(0:).  Then  the  difference  w{t2  +  ti)  —  w(ti) 
has  the  distribution  4>2(a:)  and  is  independent  of  w{ti).  We  can  construct  the 
quantities  tz,  •  •  •  ,  Xn  in  a  similar  way.  Thus  the  differences  iy(l^tii  Ti)  — 
Ti)  have  the  distributions  4>A:(a:)  and  for  different  k  are  independent.  In 
this  way,  instead  of  the  sequence  of  sums 


(65)  Si  =  $1,  S2  —  ^2,  •  '  •  ,  Sft  —  +  ^2  +  •  •  •  +  ^n, 

we  can  study  the  sequence  of  values  of  a  Brownian  process  at  the  points  iji  = 
Tl,  T72  =  Xl  -f  T2,  •  •  •  ,  T/n  =  Tl  4-  T2  -f  ’  *  *  +  T„.  If 

(66)  Var  (^,)  =  (t%  E^\  <  co,  Var  (t.)  =  a,-, 


then 


k  k  k  n  ^ 

(67)  7?.  =  E  +  E  {Ti  -  ETi)  =  T.  A  ^  (E  - 

i  =  i  i  =  l  »  =  1  7  =  X  „.y/2 

t=*l 


We  write 
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k  L  (r<  -  Eu) 

(68)  4  =  E  <^1  m  =  - >  e„  =  (E  cc,y<^. 

(E 

t-1 

In  this  notation  we  have 

(69)  w{rik)  =  w[tk  +  Cnf(4)]. 


In  the  case  when  the  quantities  are  identically  distributed 


Since  ^(k/n)  is  finite,  for  sufficiently  large  n  we  have 


(72)  w(rin)  w 

This  circumstance  can  be  used  to  obtain  estimates  of  the  rate  of  convergence 
and  to  find  asymptotic  expansions  for  the  distribution  of  functionals  defined  on 
the  successive  sums  of  independent  random  variables. 

3.2.  Let  us  now  turn  to  the  consideration  of  two  concrete  problems. 

3.2.1.  Theorem.  Let  the  random  variables  ^2,  •  •  •  ,  be  independent  and 

such  that 

(73)  =  0,  E  Var  (^,)  =  1,  =  0. 

t-1 

Further,  let  the  functions  gi{t)  and  g2{t)  be  such  that 

(74)  giit)  <  gt{t),  gri(O)  <  0  <  ^2(6), 

and  such  that  for  a  certain  k  and  for  any  t  and  h  >  0  we  have  the  inequalities 

(75)  \gi{t  +  h)  -  gfi(<)l  ^  kh,  \g2{t  +  h)  -  g2{t)\  ^  kh. 

Let  *8*  =  +  ^2  +  •  •  •  ^jfc  a,nd 

(76)  Pn  =  P{9i{ti)  <  Si  <  g2{ti);i  =  1,  2,  •  •  •  ,  n}. 


Under  the  conditions  indicated  there  exists  a  number  L,  dependent  only  on  k,  gi{0), 
and  ^2(0),  such  that 

(77)  |P„  -  P{gr(t)  <  wit)  <  g2it) ; «  G  [0, 1]}  | 


^  L 


5n  +  max  Var  (^,)  +  7n 

i 


where  jn  =  E”-i^^- 
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Proof.  In  accordance  with  (69) 

(78)  P„  =  P{gi(ti)  <  w[ti  +  e„K<t)]  <  =  1,2,  •  •  •  ,n]. 

Since  |^t|  ^  5„,  when 

(79)  S  G  [^*  +  €nf(fi),  ti+l  +  e„f(ft-|.l)] 
by  virtue  of  the  lemma, 

(80)  \w{s)  —  W[ti  +  Cnf(^)]|  <  8n. 

Therefore 

“h  —  ti)<.  w(s)  <  g2iti)  —  5n  ~  ~  ti)  'i 

\s  G  [^i  +  €n^(^i)j  ^+1  +  CnK^»+l)],  «"  =  1,2,  ' 


(81)  P 
^Pn 

^  P 

Since 


n 


giiU)  -  5n  -  k{tt+i  —  ti)  <  w(s)  <  g2{ti)  +  5„  +  /c(f,+i  -  U) ; 
S  G  “1“  ^t+1  ~f”  ^n^(^»+l)],  ^  1,2,  "  ‘  ^ 


(82)  \gj{s)  -  gj{ti)\  ^  k\s  -  <i]  ^  k(ti+i  -  U)  +  e„max  |r(^)|, 

therefore 

r^i(s)  +  8n-\-  2k  max  (<,+i  —  U)  +  e,  max  \^{ti)\  <  w(s)"| 


(83) 


P^ 


<  g^i^)  —  K  —  2k  max  (^,+i  —  i,)  —  en  max  |f(fi)| 

w  i  i 


<Pn 


<  P 


giis)  —  8n  —  2k  max  (f,-+i  —  U)  —  €„  max  |f(i»)I  <  w{sy 

i  i 

<  9'2(s)  +  8n  +  2k  max  {U+i  —  ti)  +  e„  max  |f(^,)| 


Let  us  now  note  that 

(84)  P{max|f(^)l  >  log  en^}  ^  4P{\^{t„)\  >  logen^}. 

X 

It  can  be  shown  that,  under  the  assumptions  adopted,  this  probability  turns 
out  to  be  a  quantity  of  the  order  of  5®  +  en.  Therefore 

(85)  P{gi{s)  +  h  <  w{s)  <  g2is)  —  h]  s  ^  1  +  >'n}  —  0(6»  +  Cn) 

<  P„  <  P{gi{s)  -  h  <  w{s)  <  g2(,s)  +  h;  s  ^  I  —  Vn}  +  0(5^  +  e*), 

where  . 

h  =  8n  2k  max  (i»+i  —  U)  +  v„, 

(86)  _ 

Vn  —  €n  log  €n  . 

Insofar  as  {\/a)w{a?‘u)  has  the  same  distribution  as  w(w),  we  find 
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(87)  p 0  s  u  s  1  j  -  0(s;  +  ^) 

<  p.  <  ^  i} 

+  0(5®  +  €„). 

This  gives  us 

(88)  \Pn  -  P{sfi(s)  <  w^(s)  <  </2(s);  s  G  [0, 1]}| 

<  0{hl  +  Cn)  +  P{gx{8)  -  hi  <  w{s)  <  gzis)  +  h;  s  E  [0,  1]} 

-  P{gi{s)  -P  hi  <  w{s)  <  Qiis)  -  hi;  sE[0, 1]} 

^  P{|sup  [tt;(s)  —  giis)]\  <  hi}  +  P{[sup  [w{s)  —  g2(s)]|  <  h]  +  0(5®  +  €„), 

where 

(89)  hi  =  0[max  (U+i  —  U)  +  5n  +  Vn]. 

It  can  be  shown  that  the  quantities  sup,  [m;(s)  —  sri(s)]  and  sup,  [w(s)  —  ^2(5)] 
have  finite  density.  Since  €„  =  0{yn)  this  implies  our  assertion. 

Particularizing  the  proposition  just  proved  we  obtain  the  following  theorem. 
Theorem.  If  the  random  variables  are  identically  distributed,  bounded  and 
if  E^i  =  0,  then 

-  P{gi{t)  <  w{t)  <  gi{t);  t  E  [0, 1]}1  ^  Ln-^'^  logn. 

3.2.2.  Theorem.  Let  ^1,  ?2,  •  •  •  ,  be  identically  distributed  and  independent 
random  variables,  with  E^,  =  0,  Var(^<)  =  l/n,  and  E^i  =  0{n~^).  Further,  let 
f{t,  x)  be  a  sufficiently  smooth  function  of  its  arguments  and 


I  ^  Jk  \ 

Vv  =  -  f[~’  Sk  ]. 

njfc=i  \n  / 


(92)  E<p{vr)  =  Eip^  j  f[s,  i/;(«)]ds|  +  ^  w(s)]ds| 

{[f'A  w(«)]wi(()rf<  -  M>(«)3dwi(0  +/11,  M>(l)|wi(l)}  +  o(n-‘''), 

where  w(t)  and  Wiit)  are  two  independent  Brownian  processes  and  <p(x)  a  bounded 
differentiable  function. 

In  order  to  shorten  the  formulas,  it  is  convenient  to  write 

(93)  =  + 
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Then  it  follows  that  the  quantity 

(94)  =  it /[I  W.)] 
is  distributed  in  the  same  way  as  »?„.  We  write 

(95)  =  i  t  -if  IflM’hc)]  -f\z’ 

nk=i  nk=\  L  JJ 

It  is  obvious  that 

(96)  ^  E  wi\Pk)]  =  L  f  flK  ivMlds  +  ^/(O,  0) 

nk=i  k=o  n 

-  ^  ^  (^)  -  fn  (i)]- 

It  is  easy  to  verify  that 

n-l  r<l>k^i  ri  +  cn-^'Hna) 

(97)  E  /  fbt'h  w(rPk)]ds  =  /  /(s,  w(s))ds  +  o!„ 

J<ln  Jo 

where  Or  is  such  that  E  {('nr^'^anY]  0  when  n  ^  . 

Further, 

(98)  i  t^  [kMM]  -  /[;’  “>(*.)]} 

=  cn-^nt  f,  [h  +  e,,  ^  (i),  „(^,)]  (i), 

where  0  <  dnk  <  1- 
Thus 

(99)  v,  = 

-  c«-'=  t^/[*,  w(^.)]  [i-n  (i^)  -  r.  (^)] 
+  t  S',  [I  +  9-.  ^  fn  (i).  wm]  f.  (i) 

4-  OC„. 

The  joint  distribution  of  w{s)  and  f„(s)  converges  to  the  joint  distribution  of 
a  two-dimensional  homogeneous  Gaussian  process  [w{s),  Wi{s)]  with  independent 
increments,  for  which 

(100)  Ew{s)  =  Ewi{s)  =  0, 

Evi^is)  =  Ewi{s)  =  .s, 

E{wis)wi{s)}  = 

where  jus  is  the  third  moment  of  the  quantity 
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Hence  we  find 


(101)  ^  j  w{s)]dii  +  0 

and  so,  if  <p{x)  is  a  bounded  differentiable  function,  then 

(102)  E^pirjn)  =  EM /[s,  w{s)]ds} 

+  cn-^i^E<p'  {J^  f[s,  w{s)]ds}  wit)]wiit)dt 

-  Jq  f[t,  wit)]dwiit)  +  /[I,  'U^(l)]«^i(l)} 

+  o(n~^/-). 

This  concludes  our  account  of  certain  methods  which  can  be  used  for  obtaining 
both  asymptotic  expansions  and  estimates  of  the  rate  of  convergence  for  func¬ 
tionals  derived  from  distributions  depending  on  a  parameter. 
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